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(54) Electronic mail system 

(57) An electronic mail system connected to a net- 
work includes a section for converting an image of a 
document surface into corresponding document image 
data, and a section for compressing the document 
image data into compression-resultant image data. The 
electronic mail system also includes a section for con- 
verting the compression-resultant image data into cor- 
responding image data of a given electronic-mail 
format, a section for receiving information of an elec- 
tronic-mail destination address, and a section for trans- 
mitting the image data of the electronic-mail format 
toward the electronic-mail destination address via the 
network. The electronic mail system may further include 
a section for receiving image data in an electronic mail, 
a section for converting the received image data into 
corresponding received image data of a given facsimile 
format, a section for expanding the received image data 
of the facsimile format into expansion-resultant image 
data, and a section for printing the expansion-resultant 
image data. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 

This invention relates to an electronic mail system 
which can handle image information. 

Description of the Prior Art 



SUMMARY OF THE INVENTION 
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Japanese published unexamined patent application 
2-172348 discloses a facsimile apparatus which 
includes an interface for connection with a computer 
network, and a controller for enabling an electronic mail 15 
to be outputted to the computer network via the inter- 
face. TTie facsimile apparatus is also connected to a tel- 
ephone line to receive and output image information 
from and to the telephone line. In Japanese application 
2-1 72348. the electronic mail outputted to the computer 20 
network represents a facsimile transmission result 
report or a facsimile reception result report rather than 
image information. 

United States Patent 5,479,411 discloses that 
voice, facsimile, and electronic mail messaging is inte- 25 
grated in a system which converts e-mail messages into 
voice-and-fax messages. An e-mail message is parsed 
into voiceable, prose, segments and non-voiceable, 
non-prose, segments. Prose segments are converted 
into voice message segments via text-to-speech facili- 30 
ties. Each non-prose segment is converted into a fax 
segment. Voice pointers to fax segments are inserted 
into the voice message, in places corresponding to the 
non-prose segments in the e-mail message. The voice 
file and fax file are then stored for subsequent delivery 35 
of the message as an integrated voice-and-fax mes- 
sage. Conversion of integrated voice-and-fax messages 
into e-mail messages is likewise envisioned. 
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It is an object of this invention to provide an 
improved electronic mail system. 

A first aspect of this invention provides an electronic 
mail system connected to a network which comprises 45 
means for converting an image of a document surface 
into corresponding document image data; means for 
compressing the document image data into compres- 
sion-resultant image data; means for converting the 
compression-resultant image data into corresponding so 
image data of a given electronic-mail format; means for 
receiving information of an electronic-mail destination 
address; and means for transmitting the image data of 
the electronic-mail format toward the electronic-mall 
destination address via the network. 55 

A second aspect of this invention is based on the 
first aspect thereof, and provides an electronic mail sys- 
tem further comprising means for receiving image data 
in an electronic mail; means for converting the received 



image data into corresponding received image data of a 
given facsimile format; means for expanding the 
received image data of the facsimile format into expan- 
sion-resultant image data; and means for printing the 
expansion-resultant image data. 

A third aspect of this invention is based on the first 
aspect thereof, and provides an electronic mail system 
further comprising means for transmitting character 
code data by an electronic mail. 

A fourth aspect of this invention is based on the first 
aspect thereof, and provides an electronic mail system 
wherein the destination-address receiving means com- 
prises means for recognizing an electronic-mail destina- 
tion address in a given position of the image data. 

A fifth aspect of this invention is based on the first 
aspect thereof, and provides an electronic mail system 
further comprising means for receiving information of an 
electronic-mail sender address as information of an 
electronic-mail source address, and means for, in cases 
where a transmission failure occurs, informing the elec- 
tronic-mail source address of the transmission failure. 

A sixth aspect of this invention is based on the first 
aspect thereof, and provides an electronic mail system 
further comprising means for receiving audio data, 
means for integrating the audio data and the image data 
into integration-resultant data, and means for transmit- 
ting the integration-resultant data as a single electronic 
mail. 

A seventh aspect of this invention is based on the 
first aspect thereof, and provides an electronic mail sys- 
tem further comprising means for receiving moving-pic- 
ture data, means for integrating the moving-picture data 
and the image data into integration-resultant data, and 
means for transmitting the integration-resultant data as 
a single electronic mail. 

An eighth aspect of this invention is based on the 
third aspect thereof, and provides an electronic mail 
system further comprising means for analyzing a char- 
acter sequence in a given position of received character 
code data, and means for implementing a process in 
response to a result of said analyzing. 

A ninth aspect of this invention is based on the 
eighth aspect thereof, and provides an electronic mail 
system further comprising means for. in cases where 
the analyzed character sequence indicates registration 
of a destination mail address, registering sender ID 
information in a subsequent character sequence and a 
plurality of destination mail addresses while providing a 
correspondence relation between the sender ID Infor- 
mation and the destination mail addresses, and means 
for, in cases where sender ID information is received 
during mail transmission and the sender ID information 
is equal to the registered sender ID information, indicat- 
ing the corresponding destination mall addresses and 
selecting a necessary destination from among the des- 
tination mail addresses. 

A tenth aspect of this invention is based on the 
eighth aspect thereof, and provides an electronic mail 
system further comprising means for, in cases where 
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the analyzed character sequence indicates registration 
of a source mail address, registering sender ID Informa- 
tion in a sut>sequent character sequence and a source 
mail address while providing a con^espondence relation 
between the sender ID information and the source mail 5 
address, and means for, In cases where sender ID infor- 
mation is received during mail transmission and the 
sender ID information Is equal to the registered sender 
ID information, receiving the corresponding source mall 
address as a source. 10 

An eleventh aspect of this invention is based on the 
ninth aspect thereof, and provides an electronic mail 
system further comprising means for. In cases where 
sender ID information is received during mail transmis- 
sion and the sender ID information is equal to the regis- 15 
tered sender ID information, writing information of a 
source mail address corresponding to the sender ID 
information into a header of a mall as a source. 

A twelfth aspect of this invention Is based on the 
second aspect thereof, and provides an electronic mail 20 
system further comprising means for providing a con- 
nection to a telephone line, and means for selectively 
transmitting the image data via the connection to the tel- 
ephone line according to a facsimile procedure or via 
the network according to an electronic-mail procedure. 25 

A thirteenth aspect of this invention is based on the 
twelfth aspect thereof, and provides an electronic mail 
system further comprising nheans for analyzing a char- 
acter sequence in a given position of character code 
data in a received electronic mail, means for, in cases so 
where the analyzed character sequence indicates wait 
for facsimile data reception, recognizing a notice elec- 
tronic-mail address in a subsequent character 
sequence, means for. in cases where image data is 
received via the connection to the telephone line 35 
according to a facsimile procedure after the notice elec- 
tronic-mail address is recognized, transmitting an elec- 
tronic mail representative of a reception notice to the 
notice electronic-mail address. 

A fourteenth aspect of this invention is based on the 40 
twelfth aspect thereof, and provides an electronic mail 
system further comprising means for analyzing a first 
character sequence in a given position of a header of 
image data in a received electronic mail, means for. in 
cases where the analyzed character sequence indl- 45 
cates facsimile transmission, recognizing a second 
character sequence in a given position of the header 
except the first character sequence as a facsimile 
number, and means for transmitting the received image 
data toward the facsimile number via the connection to so 
the telephone line according to a facsimile procedure. 

A fifteenth aspect of this invention is based on the 
first aspect thereof, and provides an electronic mail sys- 
tem further comprising means for identifying a country 
having a destination in response to the destination 55 
address, means for generating information of standard 
time in the identified country, and means for transmitting 
the image data as an electronic mail at a desired 
moment expressed according to the standard time in 
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the identified country. 

A sixteenth aspect of this invention Is based on the 
second aspect thereof, and provides an electronic mail 
system further comprising means for registering a plu- 
rality of electronic-mall addresses, means for storing 
and managing Image data transmitted by an electronic 
mail for each of the electronic-mail addresses, means 
for setting pass words for the respective electronic -mall 
addresses, and means for outputting the stored image 
data when a related pass word is received. 

A seventeenth aspect of this Invention is based on 
the sixteenth aspect thereof, and provides an electronic 
mail system further comprising means for generating 
Information of a cover sheet for each of the electronic- 
mail addresses, and means for adding the information 
of the cover sheet and outputting a resultant of said 
adding. 

An eighteenth aspect of this Invention is based on 
the second aspect thereof, and provides an electronic 
mail system further comprising means for. in cases 
where a first electronic mail is received, transmitting a 
second electronic mail representative of reception of the 
first electronic mail to a sender electronic-mail address 
related to the first electronic mail. 

A nineteenth aspect of this invention is based on 
the second aspect thereof, and provides an electronic 
mail system further comprising means for writing recep- 
tion ID information for each received electronic mail, 
means for providing a correspondence relation between 
a sender electronic-mail address related to the received 
electronic mail and reception ID information, and means 
for, in cases where the reception ID information is 
received, transmitting a conformation electronic mail to 
the sender electronic-mail address. 

A twentieth aspect of this invention is based on the 
second aspect thereof, and provides an electronic mall 
system further comprising means for, in cases where 
transmission of a received electronic mail fails, printing 
information representative of a transmission failure, and 
means for outputting information of a first page of the 
image data. 

A twenty-first aspect of this invention is based on 
the first aspect thereof, and provides an electronic mail 
system further comprising means for receiving charac- 
ter code data by an electronic mail. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Rg. 1 is a block diagram of an electronic mail sys- 
tem according to a first embodiment of this invention. 

Rg. 2 is a flowchart of a segment of a program for 
controlling a CPU In Rg. 1. 

Fig. 3 is a block diagram of an electronic mail sys- 
tem according to a second embodiment of this inven- 
tion. 

Rg. 4 is a flowchart of a segment of a program for 
controlling a CPU in Rg. 3. 

Rg. 5 is a block diagram of an electronic mail sys- 
tem according to a third embodiment of this Invention. 
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Fig. 6 is a flowchart of a segment of a program for 
controlling a CPU in Fig. 5. 

Fig. 7 is a block diagram of an electronic mail sys- 
tem according to a fourth embodiment of this invention. 

Fig. 8 is a flowchart of a segment of a program for 5 
controlling a CPU in Fig. 7. 

Fig. 9 is a block diagram of an electronic mail sys- 
tem according to a fifth embodiment of this invention. 

Fig. 1 0 is a flowchart of a segment of a program for 
controlling a CPU in Fig. 9. io 

Fig. 11 is a block diagram of an electronic mail sys- 
tem according to a sixth embodiment of this invention. 

Fig. 1 2 is a flowchart of a first segment of a program 
for controlling a CPU in Fig. 11. 

Fig. 13 is a flowchart of a second segment of the is 
program for controlling the CPU in Fig. 1 1 . 

Fig. 14 is a block diagram of an electronic mail sys- 
tem according to a seventh embodiment of this inven- 
tion. 

Fig. 15 is a flowchart of a segment of a program for 20 
controlling a CPU in Fig. 14. 

Fig. 16 is a block diagram of an electronic mail sys- 
tem according to an eighth embodiment of this inven- 
tion. 

Fig. 1 7 is a diagram of a part of an example of an e- 25 
mail in a given format. 

Fig. 18 is a block diagram of an electronic mail sys- 
tem according to a ninth embodiment of this invention. 

Fig. 1 9 is a flowchart of a first segment of a program 
for controlling a CPU in Fig. 18. 30 

Fig. 20 is a flowchart of a second segment of the 
program for controlling the CPU in Fig. 18. 

Fig. 21 is a block diagram of an electronic mail sys- 
tem according to a tenth embodiment of this invention. 

Fig. 22 is a flowchart of a first segment of a program 35 
for controlling a CPU in Fig. 21 . 

Fig. 23 is a flowchart of a second segment of the 
program for controlling the CPU in Fig. 21 . 

Fig. 24 is a block diagram of an electronic mail sys- 
tem according to a twelfth embodiment of this invention, 40 

Fig. 25 is a flowchart of a segment of a program for 
controlling a CPU in Fig. 24. 

Fig. 26 is a flowchart of a segment of a program for 
controlling a CPU in an electronic mail system accord- 
ing to a thirteenth embodiment of this invention. 45 

Fig. 27 is a flowchart of a segment of a program for 
controlling a CPU in an electronic mail system accord- 
ing to a fourteenth embodiment of this invention. 

Fig. 28 is a block diagram of an electronic mail sys- 
tem according to a fifteenth embodiment of this inven- so 
tion. 

Fig. 29 is a flowchart of a segment of a program for 
controlling a CPU in Fig. 28. 

Fig. 30 is a flowchart of a segment of a program for 
controlling a CPU in an electronic mail system accord- ss 
ing to a sixteenth embodiment of this invention. 

Fig. 31 is a flowchart of a segment of a program for 
controlling a CPU in an electronic mail system accord- 
ing to an eighteenth embodiment of this invention. 
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Fig, 32 is a flowchart of a segment of a program for 
controlling a CPU in an electronic mail system accord- 
ing to a nineteenth embodiment of this invention. 

Fig. 33 is a flowchart of a segment of a program for 
controlling a CPU in an electronic mail system accord- 
ing to a twentieth embodiment of this invention. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

First Embodiment 

With reference to Fig. 1, an electronic mail system 
includes a CPU 1, a ROM 2, a RAM 3, a storage unit 4, 
a format converter 5, a scanner 6, an operation panel 7, 
a data compressor 8, and a LAN (local area network) 
controller 9 which are electrically connected via a bus 
line. 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. The CPU 1 provides a work area 
in the RAM 3, and accesses and uses the work area 
during signal processing. The storage unit 4 includes, 
for example, a hard disk device which is used in storing 
data including compression-resultant image data of a 
facsimile format. The format converter 5 changes com- 
pression-resultant image data of the facsimile format 
into corresponding image data of the e-mail (electronic 
mail) format. The scanner 6 converts an image of. for 
example, a document sheet surface into corresponding 
binary image data (corresponding bi-level image data). 
The operation panel 7 has a key board, a start button, 
and other buttons. Information of the destination or the 
address of an e-mail to be transmitted can be inputted 
into the electronic mail system by operating the key 
board on the operation panel 7. The scanner 6 can be 
activated by operating the start button on the operation 
panel 7. The data compressor 8 serves to compress 
binary image data (bi-level image data) which is gener- 
ated by the scanner 6. The LAN controller 9 includes a 
LAN interface. 

The LAN controller 9 is connected via a LAN to an 
e-mail computer 9A. The e-mail computer 9A is con- 
nected to an e-mail network such as the Internet. 

As previously described, the CPU 1 operates in 
accordance with a program stored in the ROM 2. Fig. 2 
is a flowchart of a segment of the program. In the case 
where the transmission of information on a document 
sheet is required, the sheet is placed in the scanner 6 
and information of a desired destination is inputted via 
the operation panel 7. Further, the start button on the 
operation panel 7 is depressed. 

With reference to Fig. 2, a first step Si in the pro- 
gram segment decides whether or not information of the 
destination or the address of an e-mail to be transmitted 
has been inputted via the operation panel 7. In addition, 
the step S1 decides whether or not the start button on 
the operation panel 7 has been depressed. In the case 
where information of the destination of an e-mail to be 
transmitted has been inputted and the start button on 
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the operation panel 7 has been depressed, the program 
advances from the step SI to a step S2. Otherwise, the 
program repeats the step Si. Thus, the step SI waits 
the reception of an e-mail destination and the depres- 
sion of the start button. 5 

The step S2 activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner 
6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 
A step S3 following the step S2 transfers the binary 10 
image data from the scanner 6 to the data compressor 
8. Then, the step S3 activates the data compressor 8 so 
that the binary image data is compressed by the device 
8 into compression-resultant image data of a given fac- 
simile format. Further, the step S3 transfers the com- ?5 
pression-resultant image data of the facsimile format 
from the data compressor 8 to the storage unit 4 before 
storing the compression-resultant image data of the fac- 
simile format into the storage unit 4. In the case where 
the transmission of information on a plurality of docu- 20 
ment sheets (that is, a plurality of pages) is required, the 
document sheets are sequentially scanned by the 
device 6 and the compression-resultant image data of 
the facsimile format is stored into the storage unit 4 as a 
single file having a plurality of pages. 25 

A step S4 following the step S3 transfers the com- 
pression-resultant image data of the facsimile format 
from the storage unit 4 to the format converter 5. The 
step S4 activates the format converter 5 so that the 
compression-resultant image data of the facsimile for- 30 
mat is converted by the device 5 into corresponding 
image data of the e-mail format. In addition, the step S4 
transfers the image data of the e-mail format from the 
format converter 5 to the storage unit 4 before storing 
the image data of the e-mail format into the storage unit 35 
4. 

A step S5 subsequent to the step S4 transfers the 
image data of the e-mail format from the storage unit 4 
to the LAN controller 9. The step S5 activates the LAN 
controller 9 so that the image data of the e-mail format 40 
is further transferred from the LAN controller 9 to the e- 
mail computer 9A. The image data of the e-mail format, • 
that is. an e-mail is transmitted from the e-mail compu- 
ter 9A to the destination via the e-mail network 98. After 
the step S5. the current execution cycle of the program 45 
segment ends. 

The image data generated by the scanner 6 is of 
the binary type or the bi-level type. The compression- 
resultant image data of the facsimile format which is 
generated by the data compressor 8 is also of the binary so 
type or the bi-level type. The format converter 5 succes- 
sively encodes pieces of the compression-resultant fac- 
simile image data into corresponding 7-bit character 
code words respectively The 7-bit character code 
words compose text-encoded image data. Thus, the for- 55 
mat converter 5 changes the compression-resultant fac- 
simile image data into the corresponding text-encoded 
image data. The format converter 5 adds a header of a 
given format to the text-encoded image data, thereby 
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completing the image data of the e-mail format. The 
header includes information of the destination, informa- 
tion of a source address, information of the data format, 
and information of the manner of conversion from the 
image data into the character code words. The format 
related to the header and the manner of conversion 
from the image data into the character code words are 
in conformity with the Internet e-main standards 
referred to as MIME (Multipurpose Internet Mail Exten- 
sions). 

Second Embodiment 

Rg. 3 shows a second embodiment of this invention 
which is similar to the embodiment of Rgs. 1 and 2 
except for an additional arrangement described herein- 
after. 

With reference to Fig. 3. an electronic mail system 
includes a CPU 1, a ROM 2, a RAM 3, a storage unit 4, 
a format converter 5, a scanner 6, an operation panel 7, 
a data compressor/expander 8A. a LAN (local area net- 
work) controller 9, an inverse format converter 1 0, and a 
printer 1 1 which are electrically connected via a bus 
line. The inverse format converter 10 changes image 
data of the e-mail format into corresponding image data 
of a given facsimile format. The data compres- 
sor/expander 8A replaces the data compressor 8 in Fig. 
1 . The data compressor/expander 8A serves to com- 
press binary image data (bi-level image data) generated 
by the scanner 6. In addition, the data compres- 
sor/expander 8A serves to expand image data of the 
facsimile format into expansion-resultant binary image 
data (expansion-resultant bi-level image data). The 
printer 1 1 serves to print out expansion-resultant binary 
image data. 

The GPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 4 is a flowchart of a segment 
of the program. With reference to Fig. 4, a first step S1 1 
in the program segment decides whether or not data of 
the e-mail format has been received by the LAN control- 
ler 9. In the case where data of the e-mail format has 
been received, the step S1 1 transfers the received data 
of the e-mail format to the storage unit 4. The step S1 1 
controls the storage unit 4 so that the received data of 
the e-mail format is stored into the storage unit 4, In the 
case where data of the e-mail format has not yet been 
received, the program repeats the step S11. Thus, the 
step S11 waits the reception of data of the e-mail for- 
mat. 

A step S12A following the step S11 decides 
whether or not the received data of the e-mail format 
agrees with image data of the e-mail format by referring 
to related information in the header of the received data 
of the e-mail format. When the received data agrees 
with image data, the program advances from the step 
S12A to a step S12B. When the received data differs 
from image data, the program advances from the step 
S12A to a step S12C. The step S12B transfers the 
received data of the e-mail format from the storage unit 
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4 to the inverse format converter 10. The step S12B 
activates the inverse format converter 10 so that the 
received data of the e-mail format is converted by the 
device 10 into corresponding image data of a given fac- 
simile format. The step 12C controls the LAN controller 5 
9 so that a responsive e-mail representing an error will 
be transmitted to the source concerning the received 
data of the e-mail format. After the step S12C, the cur- 
rent execution cycle of the program segment ends. 

A step SI 3 following the step S12B transfers the 10 
image data of the facsimile format from the inverse for- 
mat converter 10 to the data compressor/expander 8A. 
The step Si 3 activates the data compressor/expander 
8A so that the image data of the facsimile format is 
expanded by the device 8A into expansion-resultant 15 
binary image data (expansion-resultant bi-level image 
data). Further, the step 813 transfers the expansion- 
resultant binary image data from the data compres- 
sor/expander 8A to the storage unit 4 before storing the 
expansion-resultant binary image data into the storage 20 
unit 4. 

A step S14 subsequent to the step SI 3 transfers 
the expansion-resultant binary image data from the 
storage unit 4 to the printer 11. The step S14 activates 
the printer 11 so that the expansion-resultant binary 25 
image data is visualized or printed out by the device 1 1 . 
After the step S14. the current execution cycle of the 
program segment ends. 

As previously described, the inverse format con- 
verter 1 0 changes the received data of the e-mail format 30 
into the corresponding image data of the facsimile for- 
mat. Specifically, the inverse format converter 10 
extracts text-encoded image data from the received 
data of the e-mail format. Then, the Inverse format con- 
verter 10 changes the text-encoded image data Into cor- 35 
responding binary (bi-level) image data of the facsimile 
format. 

Third Embodiment 

40 

Fig. 5 shows a third embodiment of this invention 
which is similar to the embodiment of Figs. 3 and 4 
except for an additional arrangement described herein- 
after. 

With reference to Fig. 5. an electronic mail system 45 
includes a CPU 1 , a ROM 2, a RAM 3. a storage unit 4, 
a format converter 5, a scanner 6, an operation panel 7, 
a data compressor/expander 8A, a LAN (local area net- 
work) controller 9, an inverse format converter 10, a 
printer 1 1 , and a font memory 12 which are electrically so 
connected via a bus line. The font memory 12 includes, 
for example, a ROM which stores font data providing the 
relation between character code data and Image data. 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 6 is a flowchart of a segment 55 
of the program. With reference to Rg. 6, a first step S21 
in the program segment decides whether or not data of 
the e-mail format has been received by the LAN control- 
ler 9. This decision Is to wait the reception of data of the 
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e-mail format. In the case where data of the e-mail for- 
mat has been received, the step S21 decides whether 
or not the received data of the e-mail format agrees with 
character code data by referring to the data format infor- 
mation in the header of the received data of the e-mail 
format. According to the MIME standards, the data for- 
mat information follows the information "content-type", 
and denotes "text/plain" in the case where the related 
data of the e-mail format agrees with character code 
data. It should be noted that the data format information 
denotes "Image/tiff" in the case where the related data 
of the e-mail format agrees with image data. When the 
received data of the e-mail format agrees with character 
code data, the program advances from the step S21 to 
a step S22B. When the received data of the e-mail for- 
mat agrees with image data, the received data of the e- 
mail format will be processed as in the embodiment of 
Figs. 3 and 4. 

Tlie step S22B activates the font memory 1 2 so that 
the character code data is converted into corresponding 
image data according to the font data in the font mem- 
ory 12. 

A step S23 following the step S22B transfers the 
image data to the printer 11. Also, the step S23 acti- 
vates the printer 1 1 so that the image data is visualized 
or printed out by the device 1 1 . After the step S23, the 
current execution cycle of the program segment ends. 

Fourth Embodiment 

Fig. 7 shows a fourth embodiment of this invention 
which is similar to the embodiment of Figs. 5 and 6 
except for an additional arrangement described herein- 
after 

With reference to Fig. 7, an electronic mail system 
includes a CPU 1 , a ROM 2. a RAM 3. a storage unit 4, 
a format converter 5, a scanner 6, an operation panel 7, 
a data compressor/expander 8A. a LAN (local area net- 
work) controller 9, an inverse format converter 10, a 
printer 11 , a font memory 12, and a character recogni- 
tion unit 13 which are electrically connected via a bus 
line. The character recognition unit 13 serves to recog- 
nize characters represented by binary image data (bi- 
level image data). 

Information on a document sheet which is to be 
transmitted contains information of the destination or 
the address of a transmitted e-mail. Specifically, charac- 
ters in a predetermined zone of the document sheet 
indicate an e-mail destination. Thus, the characters in 
the predetermined zone of the document sheet corre- 
spond to the information of the e-mail destination. 

The CPU 1 operates in accordance with a program 
stored In the ROM 2, Fig. 8 is a flowchart of a segment 
of the program. With reference to Fig. 8, a first step S31 
in the program segment decides whether or not a start 
button on the operation panel 7 has been depressed. In 
the case where the start button on the operation panel 7 
has been depressed, the program advances from the 
step S31 to a step S32. Othenwise, the program repeats 
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the step S31. Thus, the step S31 waits the depression 
of the start button. 

The step S32 activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner 
6 is converted by the scanner 6 into corresponding 5 
binary image data (corresponding bi-level image data). 

A step S33 following the step S32 extracts a portion 
of the binary image data which corresponds to the pre- 
determined zone. The step S33 transfers the extracted 
portion of the image data to the character recognition io 
unit 13. Further, the step S33 activates the character 
recognition unit 13 so that characters represented by 
the extracted portion of the image data are recognized 
by the device 1 3. The character recognition unit 1 3 gen- 
erates information of a destination in accordance with is 
the result of the character recognition. 

A step S34 subsequent to the step S33 transfers 
the binary image data from the scanner 6 to the data 
compressor/expander 8A. Then, the step S34 activates 
the data compressor/expander 8A so that the binary 20 
image data is compressed by the device 8A into com- 
pression-resultant image data of a given facsimile for- 
mat. Further, the step S34 transfers the compression- 
resultant image data of the facsimile format from the 
data compressor/expander 8A to the storage unit 4 25 
before storing the compression-resultant image data of 
the facsimile format into the storage unit 4. 

A step S35 following the step S34 transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. In 30 
addition, the step S35 transfers the Information of the 
destination to the format converter 5. The step S35 acti- 
vates the format converter 5 so that the compression- 
resultant image data of the facsimile format is converted 
by the device 5 into corresponding image data of the e- 35 
mail format. The image data of the e-mail format con- 
tains the information of the destination. Further, the step 
S35 transfers the image data of the e-mail format from 
the format converter 5 to the storage unit 4 before stor- 
ing the image data of the e-mail format into the storage 40 
unit 4. 

A step S36 subsequent to the step S35 transfers 
the image data of the e-mail format from the storage unit 
4 to the LAN controller 9. The step S36 activates the 
LAN controller 9 so that the image data of the e-mail for- 45 
mat is further transferred from the LAN controller 9 to an 
e-mail computer 9A. The image data of the e-mail for- 
mat, that is, an e-mail, is transmitted from the e-mail 
computer 9A to the destination via an e-mail network 
9B. After the step S36, the current execution cycle of the so 
program segment ends. 

Fifth Embodiment 

Fig. 9 shows a fifth embodiment of this invention ss 
which is similar to the embodiment of Figs. 1 and 2 
except for an additional arrangement described herein- 
after. 

With reference to Fig. 9, an electronic mail system 



includes a CPU 1 . a ROM 2. a RAM 3, a storage unit 4, 
a format converter 5, a scanner 6. an operation panel 
7A, a data compressor 8. and a LAN (local area net- 
work) controller 9 which are electrically connected via a 
bus line. The operation panel 7A replaces the operation 
panel 7 in Rg. 1. The operation panel 7A has a key 
board, a start button, a source button, and other but- 
tons. Information of the destination or the address of an 
e-mail to be transmitted can be inputted into the elec- 
tronic mail system by operating the key board on the 
operation panel 7A. The scanner 6 can be activated by 
operating the start button on the operation panel 7A. 
Information of the address of an e-mail transmission 
source can be inputted into the electronic mail system 
by operating the source button on the operation panel 
7A. The source address agrees with an address 
assigned to an e-mail computer 9A connected to the 
LAN controller 9. Accordingly, in the event that the trans- 
mission of an e-mail from the electronic mail system to 
the destination has failed, a responsive e-mail repre- 
senting the transmission failure can be received by the 
e-mail computer 9A- 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 10 is a flowchart of a segment 
of the program. With reference to Fig. 10, a first step 
S41 in the program segment decides whether or not 
information of the destination or the address of an e- 
mail to be transmitted has been inputted via the opera- 
tion panel 7A. In the case where the information of the 
destination of an e-mail to be transmitted has been 
inputted the program advances from the step S41 to a 
step S42. Otherwise, the program repeats the step S41 . 
Thus, the step S41 waits the reception of the informa- 
tion of an e-mail destination. 

The step S42 decides whether or not the source 
button on the operation panel 7A has been depressed 
to input the information of the address of the e-mail 
transmission source. In the case where the source but- 
ton on the operation panel 7A has been depressed, the 
program advances from the step S42 to a step S43. 
Otherwise, the program repeats the step S42. Thus, the 
step S42 waits the reception of the information of an e- 
mail source address. 

The step S43 decides whether or not the start but- 
ton on the operation panel 7A has been depressed. In 
the case where the start button on the operation panel 
7A has been depressed, the program advances from 
the step S43 to a step S44. Othenwise, the program 
repeats the step S43. Thus, the step S43 waits the 
depression of the start button. 

The step S44 activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner 
6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 
A step S45 following the step S44 transfers the binary 
image data from the scanner 6 to the data compressor 
8. Then, the step S45 activates the data compressor 8 
so that the binary image data is compressed by the 
device 8 into compression-resultant image data of a 
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given facsimile format. Further, the step S45 transfers 
the compression-resultant image data of the facsimile 
format from the data compressor 8 to the storage unit 4 
before storing the compression-resultant image data of 
the facsimile format into the storage unit 4. 5 

A step S46 following the step S45 transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. In 
addition, the step S46 transfers the information of the 
source address and the information of the destination to 10 
the format converter 5. The step S46 activates the for- 
mat converter 5 so that the compression-resultant 
image data of the facsimile format is converted by the 
device 5 into corresponding image data of the e-mail 
format. The image data of the e-mail format contains the is 
information of the source address and the information of 
the destination. Further, the step S46 transfers the 
image data of the e-mail format from the format con- 
verter 5 to the storage unit 4 before storing the image 
data of the e-mail format into the storage unit 4. 20 

A step S47 subsequent to the step S46 transfers 
the image data of the e-mail format from the storage unit 
4 to the LAN controller 9. The step S47 activates the 
LAN controller 9 so that the image data of the e-mail for- 
mat is further transferred from the LAN controller 9 to 25 
the e-mail computer 9A. The image data of the e-mail 
format, that is, an e-mail, is transmitted from the e-mail 
computer 9A to the destination via an e-mail network 
9B. After the step S47. the current execution cycle of the 
program segment ends. 30 

Sixth Embodiment 

Fig. 1 1 shows a sixth embodiment of this invention 
which is similar to the embodiment of Figs. 7 and 8 35 
except for an additional arrangement described herein- 
after. 

With reference to Fig, 11 , an electronic mail system 
includes a CPU 1 . a ROM 2. a RAM 3, a storage unit 4, 
a format converter 5, a scanner 6. an operation panel 40 
7B, a data compressor/expander 8A, a LAN (local area 
network) controller 9, an inverse format converter 10, a 
printer 11, a font memory 12, a character recognition 
unit 13. an audio input/output device 14. and an audio 
compressor/expander 15 which are electrically con- 45 
nected via a bus line. The operation panel 7B replaces 
the operation panel 7 in Fig. 7. The operation panel 7B 
has a start button, a message button, and other buttons. 
The scanner 6 can be activated by operating the start 
button on the operation panel 7B. The depression of the so 
message button on the operation panel 7B enables 
audio message information to be inputted into the elec- 
tronic mail system. The audio input/output device 14 
includes a microphone and an electric-to-sound trans- 
ducer such as a loudspeaker (a sound speaker). The ss 
microphone in the audio input/output device 1 4 converts 
a sound message into a corresponding audio signal. 
The audio signal is changed into corresponding audio 
data by an A/D converter in the audio input/output 
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device 14. The audio input/output device 14 also 
includes a D/A converter which changes audio data into 
a corresponding audio signal. The audio signal is con- 
verted into corresponding sound by the loudspeaker 
(the sound speaker) in the audio input/output device 14. 
The audio compressor/expander 1 5 serves to compress 
and expand audio data. 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 12 is a flowchart of a first seg- 
ment of the program. With reference to Fig. 12, a first 
step S51 in the first program segment decides whether 
or not the start button on the operation panel 7B has 
been depressed. In the case where the start button on 
the operation panel 7B has been depressed, the pro- 
gram advances from the step S51 to a step S52. Other- 
wise, the program repeats the step S51 . Thus, the step 

551 waits the depression of the start button. 

The step S52 decides whether or not the message 
button on the operation panel 7B is depressed and a 
sound message is converted by the microphone and the 
A/D converter in the audio input/output device 14 into 
corresponding audio data. This decision is to wait the 
depression of the message button and the reception of 
the audio data. In the case where the message button 
on the operation panel 7B is depressed and the sound 
message is converted by the audio input/output device 
14 into the corresponding audio data, the step S52 
transfers the audio data from the audio input/output 
device 14 to the audio compressor/expander 15. The 
step S52 activates the audio compressor/expander 15 
so that the audio data is compressed by the device 1 5 
into compression-resultant audio data. Further, the step 

552 transfers the compression-resultant audio data 
from the audio compressor/expander 15 to the storage 
unit 4 before storing the compression-resultant audio 
data into the storage unit 4. 

A step S53 subsequent to the step S52 activates 
the scanner 6 so that an image of the surface of a doc- 
ument sheet in the scanner 6 is converted by the scan- 
ner 6 into corresponding binary image data 
(corresponding bi-level image data). 

A step S54 following the step S53 extracts a portion 
of the binary image data which corresponds to a prede- 
termined zone. The step S54 transfers the extracted 
portion of the image data to the character recognition 
unit 13. Further, the step S54 activates the character 
recognition unit 13 so that characters represented by 
the extracted portion of the image data are recognized 
by the device 1 3. The character recognition unit 1 3 gen- 
erates Information of a destination in accordance with 
the result of the character recognition. 

A step S55 subsequent to the step S54 transfers 
the binary image data from the scanner 6 to the data 
compressor/expander 8A. Then, the step S55 activates 
the data compressor/expander 8A so that the binary 
image data is compressed by the device 8A into com- 
pression-resultant image data of a given facsimile for- 
mat. Further, the step S55 transfers the compression- 
resultant image data of the facsimile format from the 



8 

BNSDOCID:<EP 0801492A1> 




EP0 801 



data compressor/expander 8A to the storage unit 4 
before storing the compression-resultant image data of 
the facsimile format into the storage unit 4. 

A step S56 following the step S55 transfers the 
compression-resultant image data of the facsimile for- 5 
mat from the storage unit 4 to the format converter 5. In 
addition, the step S56 transfers the information of the 
destination to the format converter 5. Further, the step 
S56 transmits the compression-resultant audio data 
from the storage unit 4 to the format converter 5. The jo 
step S56 activates the format converter 5 so that the 
compression-resultant image data of the facsimile for- 
mat and the compression-resultant audio data are con- 
verted and integrated by the device 5 into 
corresponding image/audio data of the e-mail format. It is 
should be noted that the manner of the integration is in 
conformity with the MIME standards. The image/audio 
data of the e-mail format contains the information of the 
destination. Further, the step S56 transfers the 
image/audio data of the e-mail format from the format 20 
converter 5 to the storage unit 4 before storing the 
image/audio data of the e-mail format into the storage 
unit 4. 

A step S57 subsequent to the step S56 transfers 
the image/audio data of the e-mail format from the stor- 25 
age unit 4 to the LAN controller 9. The step S57 acti- 
vates the LAN controller 9 so that the image/audio data 
of the e-mail format is further transferred from the LAN 
controller 9 to an e-mail computer 9A. The image/audio 
data of the e-mail format, that is, an e-mail, is transmit- 30 
ted from the e-mail computer 9A to the destination via 
an e-mail network 9B. After the step S57. the current 
execution cycle of the first program segment ends. 

Fig. 13 is a flowchart of a second segment of the 
program. With reference to Fig. 13, a first step S58A in 35 
the second program segment decides whether or not 
data of the e-mail format has been received by the LAN 
controller 9. This decision is to wait the reception of data 
of the e-mail format. In the case where data of the e- 
mail format has been received, the step S58A transfers 40 
the received data of the e-mail format to the storage unit 
4. The step S58A controls the storage unit 4 so that the 
received data of the e-mail format is stored into the stor- 
age unit 4. 

A step S58B following the step S58A transfers the 45 
received data of the e-mail format from the storage unit 
4 to the inverse format converter 10. A step S58C sub- 
sequent to the step S58B decides whether or not the 
received data of the e-mail format agrees with 
image/audio data of the e-mail format by referring to so 
related information in the header of the received data of 
the e-mail format. When the received data agrees with 
image/audio data, the step S58C activates the inverse 
format converter 10 so that the received data of the e- 
mail format is converted and separated by the device 1 0 ss 
into image data of a given facsimile format and audio 
data. When the received data differs from image/audio 
data, the received data will be processed as in the 
embodiment of Figs. 3 and 4. 
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A step S58D following the step S58C transfers the 
image data of the facsimile format from the inverse for- 
mat converter 10 to the data compressor/expander 8A. 
The step S58D activates the data compressor/expander 
8A so that the image data of the facsimile format is 
expanded by the device 8A into expansion-resultant 
binary image data (expansion-resultant bi-level image 
data). Further, the step S58D transfers the expansion- 
resultant binary image data from the data compres- 
sor/expander 8A to the storage unit 4 before storing the 
expansion-resultant binary image data into the storage 
unit 4. 

A step S58E subsequent to the step S58D transfers 
the expansion-resultant binary image data from the 
storage unit 4 to the printer 1 1 . The step S58E activates 
the printer 1 1 so that the expansion-resultant binary 
image data is visualized or printed out by the device 1 1 . 

A step S58F following the step S58E transfers the 
aiKiio data from the inverse format converter 10 to the 
audio compressor/expander 15. The step S58F acti- 
vates the audio compressor/expander 15 so that the 
audio data is expanded by the device 1 5 into expansion- 
resultant audio data. Further, the step S58F transfers 
the expansion-resultant audio data from the audio com- 
pressor/expander '15 to the storage unit 4 before storing 
the expansion-resultant audio data into the storage unit 
4. 

A step S58G subsequent to the step S58F transfers 
the expansion-resultant audio data from the storage unit 
4 to the audio input/output device 14. The step S58G 
activates the audio input/output device 14 so that the 
loudspeaker (the sound speaker) and the D/A converter 
therein generate sound in response to the audio data. 
After the step S58G, the current execution cycle of the 
second program segment ends. 

Seventh Embodiment 

Fig. 14 shows a seventh embodiment of this inven- 
tion which is similar to the embodiment of Figs. 11-13 
except for an additional arrangement described herein- 
after. 

With reference to Fig. 14, an electronic mail system 
includes a CPU 1 , a ROM 2, a RAM 3, a storage unit 4. 
a format converter 5. a scanner 6, an operation panel 
7C, a data compressor/expander 8A, a LAN (local area 
network) controller 9, an inverse format converter 10. a 
printer 11, a font memory 12, a character recognition 
unit 13, an audio input/output device 14, an audio com- 
pressor/expander 15, a video input/output device 16, 
and a moving-picture compressor/expander 17 which 
are electrically connected via a bus line. The operation 
panel 7C replaces the operation panel 78 in Fig. 1 1 . 
The operation panel 7C has a start button, a video but- 
ton, and other buttons. The scanner 6 can be activated 
by operating the start button on the operation panel 7C. 
The depression of the video button on the operation 
panel 7C enables moving-picture information to be 
inputted into the electronic mail system. The video 
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input/output device 16 includes a video camera and a 
display such as a CRT. The video camera in the video 
input/output device 16 converts moving pictures into 
corresponding data. The display in the video input/out- 
put device 16 visualizes moving-picture data. The mov- 5 
ing-picture compressor/expander 17 serves to 
compress and expand moving-picture data. 

The CPU 1 operates in accordance with a program 
stored in the ROM 2, Fig. 15 is a flowchart of a segment 
of the program. With reference to Fig. 15. a first step 10 
S61 in the program segment decides whether or not the 
start button on the operation panel 7C has been 
depressed. In the case where the start button on the 
operation panel 7C has been depressed, the program 
advances from the step S61 to a step S62. Otherwise, is 
the program repeats the step S61. Thus, the step S61 
waits the depression of the start button. 

The step S62 decides whether or not the video but- 
ton on the operation panel 7C is depressed and moving 
pictures are converted by the video camera in the video 20 
input/output device 16 into corresponding data. This 
decision is to wait the depression of the video button 
and the reception of moving-picture data. In the case 
where the video button on the operation panel 7C is 
depressed and the moving pictures are converted by 25 
the video camera in the video input/output device 16 
into the corresponding data, the step S62 transfers the 
moving-picture data from the video input/output device 
16 to the moving-picture compressor/expander 17. The 
step S62 activates the moving-picture compres- 30 
sor/expander 1 7 so that the moving-picture data is com- 
pressed by the device 17 into compression-resultant 
moving-picture data. Further, the step S62 transfers the 
compression-resultant moving-picture data from the 
moving-picture compressor/expander 17 to the storage 35 
unit 4 before storing the compression-resultant moving- 
picture data into the storage unit 4. 

A step S63 subsequent to the step S62 activates 
the scanner 6 so that an image of the surface of a doc- 
ument sheet in the scanner 6 is converted by the scan- 40 
ner 6 into corresponding binary image data 
(corresponding bi-level image data). 

A step S64 following the step S63 extracts a portion 
of the binary image data which corresponds to a prede- 
termined zone. The step S64 transfers the extracted 45 
portion of the image data to the character recognition 
unit 13. Further, the step S64 activates the character 
recognition unit 13 so that characters represented by 
the extracted portion of the image data are recognized 
by the device 1 3. The character recognition unit 1 3 gen- so 
erates information of a destination in accordance with 
the result of the character recognition. 

A step S65 subsequent to the step S64 transfers 
the binary image data from the scanner 6 to the data 
compressor/expander 8A. Then, the step S65 activates ss 
the data compressor/expander 8A so that the binary 
image data is compressed by the device 8A into com- 
pression-resultant image data of a given facsimile for- 
mat. Further, the step S65 transfers the compression- 
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resultant image data of the facsimile format from the 
data compressor/expander 8A to the storage unit 4 
before storing the compression-resultant image data of 
the facsimile format into the storage unit 4. 

A step S66 following the step S65 transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. In 
addition, the step S66 transfers the information of the 
destination to the format converter 5. Further, the step 
S66 transmits the compression-resultant moving-pic- 
ture data from the storage unit 4 to the format converter 
5. The step S66 activates the format converter 5 so that 
the compression-resultant image data of the facsimile 
format and the compression-resultant moving-picture 
data are converted and integrated by the device 5 into 
corresponding image data of the e-mail format. It should 
be noted that the manner of the integration is in con- 
formity with the MIME standards. The image data of the 
e-mail format contains the information of the destina- 
tion. Further, the step S66 transfers the image data of 
the e-mail format from the format converter 5 to the stor- 
age unit 4 before storing the image data of the e-mail 
format into the storage unit 4. 

A step S67 subsequent to the step S66 transfers 
the image data of the e-mail format from the storage unit 
4 to the LAN controller 9. The step S67 activates the 
LAN controller 9 so that the image data of the e-mail for- 
mat is further transferred from the LAN controller 9 to an 
e-mail computer 9A. The image data of the e-mail for- 
mat, that is, an e-mail, is transmitted from the e-mail 
computer 9A to the destination via an e-mail network 
9B. After the step S67, the current execution cycle of the 
program segment ends. 

Eighth Embodiment 

Fig. 16 shows an eighth embodiment of this inven- 
tion which is similar to the embodiment of Figs. 7 and 8 
except for design changes described hereinafter. 

With reference to Fig. 16, an electronic mail system 
includes a CPU 1 . a ROM 2, a RAM 3, a storage unit 4, 
a format converter 5. a scanner 6, an operation panel 7, 
a data compressor/expander 8A. a LAN (local area net- 
work) controller 9X, an inverse format converter 10. a 
printer 1 1, a font memory 12, and a character recogni- 
tion unit 13 which are electrically connected via a bus 
line. The LAN controller 9X replaces the LAN controller 
9 in Fig. 7. The LAN controller 9X analyzes a received 
e-mail. The CPU 1 is programmed to execute data 
processing in response to a result of the analysis by the 
LAN controller 9X. 

Fig. 17 shows a part of an example of an e-mail in 
a given format. As shown in Fig. 17, the e-mail has a 
header 31 and a text (a message) 32. The header 31 is 
followed by the text 32. Tlie header 31 contains informa- 
tion representing a type of data in the text 32. In the 
example of Fig. 17, "Content-Type : text/plain" in the 
header 31 represents that a related portion of the text 
32 corresponds to character code data. Further. "Sub- 
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ject : !!$" in the header 31 represents that a related por- 
tion of the text 32 corresponds to an instruction (a 
command). 

The text 32 contains ID (identification) information 
of a sender, information of a list of destination mail 5 
addresses, and information of a source address. The ID 
information of the sender is preceded by a specified 
code word "!ID". The information of the list of the desti- 
nation mail addresses is preceded by a specified code 
word "ILIST". The information of the source address is io 
preceded by a specified code word "'FROM". 

Alter the LAN controller 9 receives an e-mail, the 
LAN controller 9 analyzes ID (identification) information 
of a sender, information of a list of destination mail 
addresses, and information of a source address which is 
are contained in the received e-mail. The LAN controller 
9 recognizes the sender as a result of the analysis of the 
ID information thereof. The CPU 1 serves to transfer the 
ID information of the sender, the information of the list of 
the destination mail addresses, and the information of 20 
the source address from the LAN controller 9 to the stor- 
age unit 4. Then, the CPU 1 serves to store the ID infor- 
mation of the sender, the information of the list of the 
destination mail addresses, and the information of the 
source address into the storage unit 4. 25 

Ninth Embodiment 

Fig. 18 shows a ninth embodiment of this invention 
which is similar to the embodiment of Figs. 7 and 8 30 
except for design changes described hereinafter. 

With reference to Fig. 18, an electronic mail system 
includes a CPU 1, a ROM 2. a RAM 3. a storage unit 4, 
a format converter 5, a scanner 6, an operation panel 
7D. a data compressor/expander 8A, a U\N (local area 35 
network) controller 9. an inverse format converter 10, a 
printer 1 1, a font memory 12, and a character recogni- 
tion unit 13 which are electrically connected via a bus 
line. The operation panel 7D replaces the operation 
panel 7 in Fig. 7. The operation panel 7D has a display, 40 
a key board, a start button, a destination list button, and 
other buttons. Information of a destination list can be 
visualized by the display on the operation panel 7D. ID 
information of a sender can be inputted into the elec- 
tronic mail system by operating the key board on the 45 
operation panel 7D. The scanner 6 can be activated by 
operating the start button on the operation panel 7D, 
The depression of the destination list button on the 
operation panel 7D enables a destination list to be indi- 
cated by display on the operation panel 7D. so 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 19 is a flowchart of a first seg- 
ment of the program. With reference to Fig. 19. a first 
step S71 in the first program segment decides whether 
or not character code data in an e-mail has been ss 
received by the LAN controller 9. In the case where the 
character code data in the e-mail has been received, 
the program advances from the step S71 to a step S72. 
Othenwise, the program repeats the step S71 . Thus, the 



step S71 waits the reception of character code data in 
an e-mail. The st^ S72 analyzes the "Subject" part of 
the header of the e-mail. 

A step S73 following ttie step S72 decides whether 
or not the "Subject" part of the header corresponds to a 
text instruction by referring to the result of the analysis 
by the step S72. When the "Subject" part of the header 
corresponds to a text instruction, the program advances 
from the step S73 to a step S74. Othenwise, the pro- 
gram advances from the step S73 to a step S76. 

The step S74 analyzes the text in the e-mail to 
extract ID information of a sender and information of a 
destination mail list therefrom. A step S75 following the 
step S74 stores or registers the ID information of the 
sender and the information of the destination mail list 
into the storage unit 4 in a manner such that the ID infor- 
mation of the sender and the information of the destina- 
tion mail list are in a given correspondence relation. 
Alter the step S75. the current execution cycle of the 
first program segment ends. 

The step S76 converts character code data in the 
text into corresponding image data. A step S77 follow- 
ing the step S76 transfers the image data to the printer 
1 1 . The step S77 activates the printer 1 1 so that the 
image data is visualized or printed out by the device 1 1 . 
After the step S77, the current execution cycle of the 
first program segment ends. 

Fig. 20 is a flowchart of a second segment of the 
program. With reference to Fig. 20. a first step S81 of 
the second program segment decides whether or not 
the destination list button on the operation panel 7D has 
been depressed. In the case where the destination list 
button on the operation panel 7D has been depressed, 
the program advances from the step S81 to a step S82. 
Otherwise, the program repeats the step S81 . Thus, the 
step S82 waits the depression of the destination list but- 
ton. 

The step S82 decides whether or not ID information 
of a sender has been inputted via the operation panel 
7D. This decision is to wait the reception of sender ID 
information. In the case where the ID information of the 
sender has been inputted, the step S82 reads out infor- 
mation of a destination mail list from the storage unit 4 
which corresponds to the ID information of the sender. 
The step S82 transfers the information of the destina- 
tion mail list to the display on the operation panel 7D. 
The step S82 activates the display on the operation 
panel 7D so that the information of the destination mail 
list is visualized thereby 

A step S83 following the step S82 decides whether 
or not a destination has been selected from the visual- 
ized destination mail list by actuating the operation 
panel 7D. In the case where a destination has been 
selected, the program advances from the step S83 to a 
step S84. Otherwise, the program repeats the step S83. 
Thus, the step S83 waits the selection of a destination. 

The step S84 decides whether or not the start but- 
ton on the operation panel 7D has been depressed. In 
the case where the start button on the operation panel 
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7D has been depressed, the program advances from 
the step S84 to a step S85. Othenwise. the program 
repeats the step S84. Thus, the step S84 waits the 
depression of the start button. 

The step S85 activates the scanner 6 so that an 5 
image of the surface of a document sheet in the scanner 
6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 

A step S86 subsequent to the step S85 transfers 
the binary image data from the scanner 6 to the data io 
compressor/expander 8A. Then, the step S86 activates 
the data compressor/expander 8A so that the binary 
image data is compressed by the device 8A into com- 
pression-resultant image data of a given facsimile for- 
mat. Further, the step S86 transfers the compression- 75 
resultant image data of the facsimile format from the 
data compressor/expander 8A to the storage unit 4 
before storing the compression-resultant image data of 
the facsimile format into the storage unit 4. 

A step S87 following the step S86 transfers the 20 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5, In 
addition, the step S87 informs the format converter 5 of 
the selected destination. The step S87 activates the for- 
mat converter 5 so that the compression-resultant 25 
image data of the facsimile format is converted by the 
device 5 into corresponding image data of the e-mail 
format. The image data of the e-mail format contains the 
information of the destination. Further, the step S87 
transfers the image data of the e-mail format from the 30 
format converter 5 to the storage unit 4 before storing 
the image data of the e-mail format into the storage unit 
4. 

A step S88 subsequent to the step S87 transfers 
the image data of the e-mail format from the storage unit 35 
4 to the LAN controller 9. The step S88 activates the 
LAN controller 9 so that the image data of the e-mail for- 
mat is further transferred from the LAN controller 9 to an 
e-mail computer 9A. The image data of the e-mail for- 
mat, that is. an e-mail, is transmitted from the e-mail 40 
computer 9A to the selected destination via an e-mail 
network 9B. After the step S88. the current execution 
cycle of the second program segment ends. 

Tenth Embodiment 45 

Fig. 21 shows a tenth embodiment of this Invention 
which is similar to the embodiment of Figs. 18-20 except 
for design changes described hereinafter. 

With reference to Fig. 21 , an electronic mail system so 
includes a CPU 1 . a ROM 2. a RAM 3, a storage unit 4. 
a format converter 5, a scanner 6, an operation panel 
7E. a data compressor/expander 8A. a LAN (local area 
network) controller 9, an inverse format converter 10, a 
printer 1 1 , a font memory 12, and a character recogni- 55 
tion unit 13 which are electrically connected via a bus 
line. The operation panel 7E replaces the operation 
panel 7D in Fig. 18. The operation panel 7E has a dis- 
play, a key board, a start button, a source button, and 
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other buttons. Information of a source address can be 
visualized by the display on the operation panel 7E. 
Information of the destination or the address of an e- 
mail to be transmitted can be inputted into the electronic 
mail system by operating the key board on the operation 
panel 7E. ID information of a sender can be inputted 
into the electronic mail system by operating the source 
button on the operation panel 7E. The scanner 6 can be 
activated by operating the start button on the operation 
panel 7E. 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 22 is a flowchart of a first seg- 
ment of the program. With reference to Fig. 22, a first 
step S71A in the first program segment decides 
whether or not character code data in an e-mail has 
been received by the LAN controller 9. In the case 
where the character code data in the e-mail has been 
received, the program advances from the step S71 A to 
a step S72A. Othenwise, the program repeats the step 
S71A. Thus, the step S71 A waits the reception of char- 
acter code data in an e-mail. The step S72A analyzes 
the "Subject" part of the header of the e-mail. 

A step S73A following the step S72A decides 
whether or not the "Subject" part of the header corre- 
sponds to a text instruction by referring to the result of 
the analysis by the step S72A. When the "Subject" part 
of the header corresponds to a text instruction, the pro- 
gram advances from the step S73A to a step S74A. 
Othenwise, the program advances from the step S73A 
to a step S76A. 

The step S74A analyzes the text in the e-mail to 
extract ID information of a sender and information of a 
source address therefrom. A step S75A following the 
step S74A stores or registers the ID information of the 
sender and the information of the source address into 
the storage unit 4 in a manner such that the ID informa- 
tion of the sender and the information of the source 
address are in a given correspondence relation. After 
the step S75A, the current execution cycle of the first 
program segment ends. 

TTie step S76A converts character code data in the 
text into corresponding image data. A step S77A follow- 
ing the step S76A transfers the image data to the printer 
11. The step S77A activates the printer 1 1 so that the 
image data is visualized or printed out by the device 1 1 . 
After the step S77A, the current execution cycle of the 
first program segment ends. 

Fig. 23 is a flowchart of a second segment of the 
program. With reference to Fig. 23. a first step S82A of 
the second program segment decides whether or not ID 
information of a sender has been inputted by depress- 
ing the source button on the operation panel 7E. This 
decision is to wait the reception of sender ID informa- 
tion. In the case where the ID information of the sender 
has been inputted, the step S82A reads out information 
of a source address from the storage unit 4 which corre- 
sponds to the ID information of the sender. The step 
S82A transfers the information of the source address to 
the display on the operation panel 7E. The step S82A 
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activates the display on the operation panel 7E so that 
the information of the source address is visualized 
thereby. Thus, it is possible to confirm the source 
address. 

A step S83A following the step S82A decides 
whether or not information of the destination or the 
address of an e-mail to be transmitted has been input- 
ted via the operation panel 7E. In the case where the 
information of the destination of an e-mail to be trans- 
mitted has been inputted, the program advances from 
the step S83A to a step S84A. Othenwise, the program 
repeats the step S83A. Thus, the step S83A waits the 
reception of the information of the destination. 

The step S84A decides whether or not the start but- 
ton on the operation panel 7E has been depressed. In 
the case where the start button on the operation panel 
7E has been depressed, the program advances from 
the step S84A to a step S85A. Othenwise. the program 
repeats the step S84A. Thus, the step S84A waits the 
depression of the start button. 

The step S85A activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner 
6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 

A step S86A subsequent to the step S85A transfers 
the binary image data from the scanner 6 to the data 
compressor/expander 8A. Then, the step S86A acti- 
vates the data compressor/expander 8A so that the 
binary image data is compressed by the device 8A into 
compression-resultant image data of a given facsimile 
format. Further, the step S86A transfers the compres- 
sion-resultant image data of the facsimile format from 
the data compressor/expander 8A to the storage unit 4 
before storing the compression-resultant image data of 
the facsimile format into the storage unit 4. 

A step S87A following the step S86A transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. In 
addition, the step S87A transfers the information of the 
source address and the information of the destination to 
the format converter 5. The step S87A activates the for- 
mat converter 5 so that the compression-resultant 
image data of the facsimile format is converted by the 
device 5 into corresponding image data of the e-mail 
format. The image data of the e-mail format contains the 
information of the source address and the information of 
the destination. Further, the step S87A transfers the 
image data of the e-mail format from the format con- 
verter 5 to the storage unit 4 before storing the image 
data of the e-mail format into the storage unit 4. 

A step S88A subsequent to the step S87A transfers 
the image data of the e-mail format from the storage unit 
4 to the LAN controller 9. The step S88A activates the 
LAN controller 9 so that the image data of the e-mail for- 
mat is further transferred from the LAN controller 9 to an 
e-mail computer 9A. The image data of the e-mail for- 
mat, that is. an e-mail, is transmitted from the e-mail 
computer 9A to the destination via an e-mail network 
9B. After the step S88A, the current execution cycle of 



the second program segment ends. 
Eleventh Embodiment 

5 An eleventh embodiment of this invention is similar 

to the embodiment of Figs. 18-20 except for design 
changes described hereinafter. 

In the eleventh embodiment, when ID information of 
a sender is inputted, a source address corresponding to 

10 the ID information of the sender is recognized. Informa- 
tion of the source address is automatically written into 
the header of an e-mail carrying image data. 

Twelfth Embodiment 

75 

Fig. 24 shows a twelfth embodiment of this inven- 
tion which is similar to the embodiment of Figs. 1 4 and 
15 except for design changes described hereinafter. 
With reference to Fig. 24, an electronic mail system 

20 includes a CPU 1 , a ROM 2, a RAM 3. a storage unit 4. 
a format converter 5. a scanner 6. an operation panel 
7F. a data compressor/expander 8A, a LAN (local area 
network) controller 9, an inverse format converter 10. a 
printer 11, a font memory 12, a character recognition 

25 unit 13, an audio input/output device 14, an audio com- 
pressor/expander 15, a video input/output device 16, a 
moving-picture compressor/expander 17, and a modem 
18 which are electrically connected via a bus line. The 
operation panel 7F replaces the operation panel 7C in 

30 Fig. 14. The operation panel 7F has a key board, a start 
button, a mode selection button, and other buttons. 
Information of the destination or the address of an e- 
mail to be transmitted can be inputted into the electronic 
mail system by operating the key board on the operation 

35 panel 7F. In addition, information of a destination tele- 
phone number can be inputted into the electronic mail 
system by operating the key board on the operation 
panel 7F. The scanner 6 can be activated by operating 
the start button on the operation panel 7F. Operation of 

40 the electronic mail system can be changed between an 
e-mail mode and a facsimile mode by operating the 
mode selection button on the operation panel 7R The 
modem 18 is connected to a telephone line. The 
modem 18 serves to transmit and receive a facsimile 

45 signal to and from the telephone line. 

The CPU 1 operates In accordance with a program 
stored in the ROM 2. Fig. 25 is a flowchart of a segment 
of the program. With reference to Fig. 25, a first step 
S91 in the program segment decides whether or not the 

50 mode selection button on the operation panel 7F has 
been operated. In the case where the mode selection 
button on the operation panel 7F has been operated, 
the program advances from the step S91 to a step S92. 
Othenwise, the program repeats the step S91 . Thus, the 

55 Step S91 waits operation of the mode selection button. 
The step S92 decides which of the e-mail mode and 
the facsimile mode has been selected by referring to a 
signal coming from the mode selection button on the 
operation panel 7F. When the facsimile mode has been 
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selected, the program advances from the step S92 to a 
step S93. When the e-mail mode has been selected, the 
program advances from the step S92 to a step S96. 

The step S93 decides whether or not information of 
a destination telephone number has been inputted via 5 
the operation panel 7F Also, the step S93 decides 
whether or not the start button on the operation panel 
7F has been depressed. In the case where the Informa- 
tion of the destination telephone number has been 
inputted and the start button on the operation panel 7F 10 
has been depressed, the program advances from the 
step S93 to a step S94. Othenwise, the program repeats 
the step S93. Thus, the step S93 waits the reception of 
information of a destination telephone number and the 
depression of the start button. 15 

The step S94 activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner 
6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bl-level image data). 
A step S95A following the step S94 transfers the binary 20 
image data from the scanner 6 to the data compres- 
sor/expander 8A. Then, the step S95A activates the 
data compressor/expander 8A so that the binary image 
data is compressed by the device 8 into compression- 
resultant image data of a given facsimile format. 25 

A step S95B subsequent to the step S95A transfers 
the compression-resultant image data of the facsimile 
format from the data compressor/expander 8A to the 
modem 18. The step S95B activates the modem 18 so 
that the compression-resultant image data of the fac- 30 
simile format (that is. the facsimile signal) is outputted 
from the modem 18 to the telephone line. Normally, the 
facsimile signal is transmitted via the telephone line to 
the communication opposite party identified by the des- 
tination telephone number. After the step S95B. the cur- 35 
rent execution cycle of the program segment ends. 

The step S96 decides whether or not information of 
the destination or the address of an e-mail to be trans- 
mitted has been inputted via the operation panel 7F. In 
addition, the step S98 decides whether or not the start 40 
button on the operation panel 7F has been depressed. 
In the case where information of the destination of an e- 
mail to be transmitted has been inputted and the start 
button on the operation panel 7F has been depressed, 
the program advances from the step S96 to a step S97. 45 
Othenwise. the program repeats the step S96. Thus, the 
step S96 waits the reception of information of an e-mail 
destination and the depression of the start button. 

The step S97 activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner so 
6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 
A step S98A following the step S97 transfers the binary 
image data from the scanner 6 to the data compres- 
sor/expander 8A. Then, the step S98A activates the ss 
data compressor/expander 8A so that the binary image 
data is compressed by the device 8 into compression- 
resultant image data of a given facsimile format. Fur- 
ther, the step S98A transfers the compression-resultant 
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image data of the facsimile format from the data com- 
pressor/expander 8A to the storage unit 4 before storing 
the compression-resultant image data of the facsimile 
format into the storage unit 4. In the case where the 
transmission of information on a plurality of document 
sheets (that is, a plurality of pages) is required, the doc- 
ument sheets are sequentially scanned by the device 6 
and the compression-resultant image data of the fac- 
simile format is stored into the storage unit 4 as a single 
file having a plurality of pages. 

A step S98B following the step S98A transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. 
The step S98B activates the format converter 5 so that 
the compression-resultant image data of the facsimile 
format is converted by the device 5 into corresponding 
image data of the e-mail format. In addition, the step 
S98B transfers the image data of the e-mail format from 
the format converter 5 to the storage unit 4 before stor- 
ing the image data of the e-mail format into the storage 
unit 4. 

A step S99 subsequent to the step S98B transfers 
the image data of the e-mail format from the storage unit 
4 to the LAN controller 9. The step S99 activates the 
LAN controller 9 so that the image data of the e-mail for- 
mat is further transferred from the LAN controller 9 to an 
e-mail computer 9A. The image data of the e-mail for- 
mat, that is, an e-mail, is transmitted from the e-mail 
computer 9A to the destination via an e-mail network 
9B. After the step S99, the current execution cycle of the 
program segment ends. 

Thirteenth Embodiment 

A thirteenth embodiment of this invention is similar 
to the embodiment of Figs. 24 and 25 except for design 
changes described hereinafter. 

Fig. 26 is a flowchart of a segment of a program for 
controlling a CPU 1 (see Fig. 24) in the thirteenth 
embodiment. With reference to Fig. 26, a first step S101 
in the program segment decides whether or not data of 
the e-mail format has been received by a LAN controller 
9 (see Fig. 24). This decision is to wait the reception of 
data of the e-mail format. In the case where data of the 
e-mail format has been received, the step S101 trans- 
fers the received data of the e-mail format to a storage 
unit 4 (see Fig. 24). The step S101 controls the storage 
unit 4 so that the received data of the e-mail format is 
stored into the storage unit 4. 

A step SI 02 following the step SI 01 decides 
whether or not the received data of the e-mail format 
agrees with image data of the e-mail format by referring 
to related information in the header of the received data 
of the e-mail format. When the received data agrees 
with image data, the program advances from the step 
SI 02 to a step SI 03. When the received data differs 
from image data, the program advances from the step 
SI 02 to a step Si 04. The step SI 03 transfers the 
received data of the e-mail format from the storage unit 
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4 to an inverse format converter 10 (see Fig. 24). The 
step SI 03 activates the inverse format converter 10 so 
that the received data of the e-mail format is converted 
by the device 10 into con^esponding image data of a 
given facsimile format. The step 104 controls a LAN 5 
controller 9 (see Fig. 24) so that a responsive e-mail 
representing an error will be transmitted to the source 
concerning the received data of the e-mail format. After 
the step S104. the current execution cycle of the pro- 
gram segment ends. 10 

A step Si 05 following the step SI 03 transfers the 
image data of the facsimile format from the inverse for- 
mat converter 10 to a data compressor/expander 8A 
(see Fig. 24). The step S105 activates the data com- 
pressor/expander 8A so that the image data of the fac- js 
simile format is expanded by the device 8A into 
expansion-resultant binary image data (expansion- 
resultant bi-level image data). Further, the step SI 05 
transfers the expansion-resultant binary image data 
from the data compressor/expander 8A to the storage 20 
unit 4 before storing the expansion-resultant binary 
image data into the storage unit 4. 

A step S106 subsequent to the step SI 05 transfers 
the expansion-resultant binary image data from the 
storage unit 4 to a printer 1 1 (see Fig. 24). The step 25 
S106 activates the printer 11 so that the expansion- 
resultant binary image data is visualized or printed out 
by the device 1 1 . 

A step SI 07 following the step SI 06 decides 
whether or not a reception waiting flag has been set. 30 
When the reception waiting flag has been set. the pro- 
gram advances from the step SI 07 to a step Si 08. Oth- 
erwise, the program exits from the step S107, and the 
current execution cycle of the program segment ends. 

The step 108 controls the LAN controller 9 so that 35 
an e-mail representing a reception notice will be trans- 
mitted to a previously-registered terminal (a previously- 
registered terminal station). After the step SI 08, the 
current execution cycle of the program segment ends. 

Setting the reception waiting flag is implemented by 40 
previously transmitting an e-mail in which a text has 
"IRCV SET" according to the format of Fig. 17. Reset- 
ting the reception waiting flag is implemented by trans- 
mitting an e-mail in which a text has "IRCV RESET" 
according to the format of Fig. 17. 45 

Fourteenth Embodiment 

A fourteenth embodiment of this invention is similar 
to the embodiment of Figs. 24 and 25 except for design so 
changes described hereinafter. 

Fig. 27 is a flowchart of a segment of a program for 
controlling a CPU 1 (see Fig. 24) in the fourteenth 
embodiment. With reference to Fig. 27, a first step S1 10 
in the program segment decides whether or not image ss 
data of the e-mail format (an e-mail) has been received 
by a LAN controller 9 (see Fig. 24). This decision is to 
wait the reception of image data of the e-mail format. In 
the case where image data of the e-mail format has 




been received, the step Si 10 transfers the received 
image data of the e-mail format to a storage unit 4 (see 
Fig. 24). The step Si 10 controls the storage unit 4 so 
that the received image data of the e-mail format is 
stored into the storage unit 4. 

A step S1 1 1 following the step S1 10 transfers the 
received image data of the e-mail format from the stor- 
age unit 4 to an inverse format converter 10 (see Fig. 
24). The step S111 activates the inverse format con- 
verter 10 so that the received image data of the e-mail 
format is converted by the device 10 into corresponding 
image data of a given facsimile format. Then, the step 
S1 11 transfers the image data of the facsimile format 
from the inverse format converter 10 to the storage unit 
4 before storing the image data of the facsimile format 
into the storage unit 4. 

A step S1 12 subsequent to the step S1 1 1 analyzes 
the "Subject" part of the header of the received e-mail. 
In the case where the analyzed "Subject" part of the 
header includes a requirement for facsimile transmis- 
sion, the step S1 12 extracts information of a destination 
telephone number from a portion of the received e-mail 
which immediately follows the "Subject" part. 

A step S1 13 following the step S1 12 decides 
whether or not a requirement for facsimile transmission 
is present. When a requirement for facsimile transmis- 
sion is present, the program advances from the step 
S1 13 to a step S1 14. Othenwise. the program advances 
from the step S1 13 to a step Si 15A. 

The step S1 14 transfers the image data of the fac- 
simile format from the storage unit 4 to a modem 18 
(see Fig. 24). The step S1 14 activates the modem 18 so 
that the image data of the facsimile format (that is, the 
facsimile signal) is outputted from the modem 18 to a 
telephone line. Normally, the facsimile signal is transmit- 
ted via the telephone line to the communication oppo- 
site party identified by the destination telephone 
number. After the step S1 14, the current execution cycle 
of the program segment ends. 

A step S1 15A transfers the image data of the fac- 
simile format from the storage unit 4 to a data compres- 
sor/expander 8A (see Fig. 24). The step S115A 
activates the data compressor/expander 8A so that the 
image data of the facsimile format is expanded by the 
device 8A into expansion-resultant binary image data 
(expansion-resultant bi-level image data). Further, the 
step S115A transfers the expansion-resultant binary 
image data from the data compressor/expander 8A to 
the storage unit 4 before storing the expansion-resultant 
binary image data into the storage unit 4. 

A step SI 15B subsequent to the step SI 15A trans- 
fers the expansion-resultant binary image data from the 
storage unit 4 to a printer 11 (see Fig. 24). The step 
S115B activates the printer 11 so that the expansion- 
resultant binary image data is visualized or printed out 
by the device 1 1 . After the step S1 1 5B, the current exe- 
cution cyde of the program segment ends. 
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Fifteenth Embcxiiment 

Fig. 28 shows a fifteenth embodiment of this inven- 
tion which is similar to the embodiment of Figs. 24 and 
25 except for an additional arrangement described 5 
hereinafter. 

With reference to Fig. 28, an electronic mail system 
includes a CPU 1 . a ROM 2, a RAM 3. a storage unit 4, 
a format converter 5, a scanner 6, an operation panel 
7F, a data compressor/expander 8A, a LAN (local area io 
network) controller 9, an inverse format converter 10, a 
printer 11, a font memory 12. a character recognition 
unit 13, an audio input/output device 14, an audio com- 
pressor/expander 15, a video input/output device 16, a 
moving-picture compressor/expander 17, a modem 18, is 
and a world clock 19 which are electrically connected 
via a bus line. The world clock 19 generates information 
of standard time in every country in the world. 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 29 is a flowchart of a segment 20 
of the program. With reference to Fig. 29, a first step 
S121 in the program segment decides whether or not 
information of the destination or the address of an e- 
mail to be transmitted has been inputted via the opera- 
tion panel 7F In the case where the information of the 25 
destination of an e-mail to be transmitted has been 
inputted, the program advances from the step Si 21 to a 
step SI 22. Otherwise, the program repeats the step 
Si 21 . Thus, the step S121 waits the reception of desti- 
nation information. 30 

The step 8122 sets desired time for e-mail trans- 
mission which is expressed according to standard time 
in a country having an e-mail destination. A step S123 
following the step SI 22 decides whether or not the start 
button on the operation panel 7F has been depressed. 35 
In the case where the start button on the operation 
panel 7F has been depressed, the program advances 
from the step S123 to a step S124. Otherwise, the pro- 
gram repeats the step SI 23. Thus, the step Si 23 waits 
the depression of the start button. 40 

The step SI 24 activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner 
6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bt-level image data). 
A step S125A following the step S124 transfers the 45 
binary image data from the scanner 6 to the data com- 
pressor/expander 8A. Then, the step S125A activates 
the data compressor/expander 8A so that the binary 
image data is compressed by the device 8A into com- 
pression-resultant image data of a given facsimile for- 50 
mat. Further, the step S125A transfers the 
compression-resultant image data of the facsimile for- 
mat from the data compressor/expander 8A to the stor- 
age unit 4 before storing the compression-resultant 
image data of the facsimile format into the storage unit 55 
4. 

A step S125B following the step Si 25 A transfers 
the compression-resultant image data of the facsimile 
format from the storage unit 4 to the format converter 5. 
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In addition, the step S125B transfers the information of 
the e-mail destination to the format converter 5. The 
step S125B activates the format converter 5 so that the 
compression-resultant image data of the facsimile for- 
mat is converted by the device 5 into corresponding 
image data of the e-mail format. Further, the step 
S125B transfers the image data of the e-mail format 
from the format converter 5 to the storage unit 4 before 
storing the image data of the e-mail format into the stor- 
age unit 4. 

A step SI 26 following the step S125B detects a 
destination's country from the information of the e-mail 
destination. It is well-known that an end part of informa- 
tion of an e-mail destination indicates the destination's 
country. A step SI 27 subsequent to the step SI 26 
detects present time in the destination's country by 
referring to the information generated by the world clock 
19. The step Si 27 decides whether or not the present 
time in the destination's country reaches the desired 
time for e-mail transmission. This decision is to wait a 
moment at which the present time in the destination's 
country reaches the desired time for e-mail transmis- 
sion. In the case where the present time in the destina- 
tion's country reaches the desired time for e-mail 
transmission, the step SI 27 transfers the image data of 
the e-mail format from the storage unit 4 to the LAN con- 
troller 9. The step SI 27 activates the LAN controller 9 
so that the image data of the e-mail format is further 
transferred from the LAN controller 9 to an e-mail com- 
puter 9A. The image data of the e-mail format, that is, 
an e-mail, is transmitted from the e-mail computer 9A to 
the destination via an e-mail network 9B. After the step 
SI 27, the current execution cycle of the program seg- 
ment ends. 

Sixteenth Embodiment 

A sixteenth embodiment of this invention is similar 
to the embodiment of Figs. 24 and 25 except for design 
changes described hereinafter. 

Fig. 30 is a flowchart of a segment of a program for 
controlling a CPU 1 (see Fig. 24) in the sixteenth 
embodiment. With reference to Fig. 30. a first step Si 31 
in the program segment decides whether or not image 
data of the e-mail format (an e-mail) has been received 
by a LAN controller 9 (see Fig. 24). This decision is to 
wait the reception of image data of the e-mail format. In 
the case where image data of the e-mail format has 
been received, the step SI 31 transfers the received 
image data of the e-mail format to a storage unit 4 (see 
Fig. 24). The Step S131 controls the storage unit 4 so 
that the received image data of the e-mail format is 
stored into the storage unit 4. 

A step S132 following the step S131 transfers the 
received image data of the e-mail format from the stor- 
age unit 4 to an inverse format converter 10 (see Rg. 
24). The step S132 activates the inverse format con- 
verter 10 so that the received image data of the e-mail 
format is converted by the device 10 into corresponding 
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image data of the facsimile format. 

A step SI 33 subsequent to the step S132 transfers 
the image data of the facsimile format from the inverse 
format converter 10 to the storage unit 4. and then stor- 
ing the image data of the facsimile format into a box s 
which is provided in the storage unit 4 for the related 
destination. It should be noted that boxes provided in 
the storage unit 4 have a correspondence relation with 
previously-registered owner's ID information and previ- 
ously-registered pass words. 

A step S134 following the step S133 decides 
whether or not owner's ID information and a pass word 
are inputted. This decision is to wait the reception of 
owner's ID information and a pass word. In the case 
where owner's ID information and a pass word are is 
inputted, the step Si 34 decides whether or not the 
inputted owner's ID information and the inputted pass 
word are acceptable. In the case where the inputted 
owner's ID information and the inputted pass word are 
acceptable, the program advances from the step Si 34 20 
to a step S135A. Otherwise, the current execution cycle 
of the program segment ends. 

The step S135A reads out the image data of the 
facsimile format from the box in the storage unit 4 which 
corresponds to the inputted owner's ID information and 25 
the inputted pass word. The step S135A transfers the 
image data of the facsimile format to a data compres- 
sor/expander 8A (see Fig, 24). The step S135A acti- 
vates the data compressor/expander 8A so that the 
image data of the facsimile format is expanded by the 30 
device 8A into expansion-resultant binary image data 
(expansion-resultant bi-level image data). 

A step S135B subsequent to the step S135A trans- 
fers the expansion-resultant binary image data from the 
data compressor/expander 8A to a printer 1 1 (see Fig. 35 
24). The step S135B activates the printer 1 1 so that the 
expansion-resultant binary image data is visualized or 
printed out by the device 1 1 . After the step S135B, the 
current execution cycle of the program segment ends. 

40 

Seventeenth Embodiment 

A seventeenth embodiment of this invention is sim- 
ilar to the embodiment of Fig. 30 except for design 
changes described hereinafter. In the seventeenth 45 
embodiment, the step S134 is omitted from the program 
segment of Fig. 30. and the step S133 is immediately 
followed by the step S1 35A. 

Information of owner's cover sheet is previously 
registered in a related box of a storage unit 4 (see Fig. so 
24). The registration is implemented by using a scanner 
6 (see Fig. 24) or transmitting an e-mail having a cover- 
sheet registering instruction. 

In the seventeenth embodiment, the step S135B is 
modified so that information of a cover sheet is read out 55 
from the storage unit 4. and the information of the cover 
sheet is added to expansion-resultant binary image 
data. Accordingly, a combination of the cover-sheet 
information and the expansion-resultant binary image 
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data is visualized or printed out by a printer 1 1 (see Rg. 
24). 

Eighteenth E mbodiment 

An eighteenth emlxxiiment of this invention is simi- 
lar to the embodiment of Figs. 24 and 25 except for 
design changes described hereinafter. 

Rg. 31 is a flowchart of a segment of a program for 
controlling a CPU 1 (see Fig. 24) in the eighteenth 
embodiment. With reference to Fig. 31 . a first step S141 
in the program segment decides whether or not image 
data of the e-mail format (an e-mail) has been received 
by a LAN controller 9 (see Fig. 24). This decision is to 
wait the reception of image data of the e-mail format. In 
the case where image data of the e-mail format has 
been received, the step S141 transfers the received 
image data of the e-mail format to a storage unit 4 (see 
Fig. 24). The step S141 controls the storage unit 4 so 
that the received image data of the e-mail format is 
stored into the storage unit 4. 

A step SI 42 following the step S141 transfers the 
received image data of the e-mail format from the stor- 
age unit 4 to an inverse format converter 10 (see Fig. 
24). The step S142 activates the inverse format con- 
verter 10 so that the received image data of the e-mail 
format is converted by the device 10 into corresponding 
image data of a given facsimile format. The step Si 42 
transfers the image data of the facsimile format to the 
storage unit 4 before storing the image data of the fac- 
simile format into the storage unit 4. 

A step S143A following the step SI 42 transfers the 
image data of the facsimile format from the storage unit 
4 to a data compressor/expander 8A (see Fig. 24). The 
step S143A activates the data compressor/expander 8A 
so that the image data of the facsimile format is 
expanded by the device 8A into expansion-resultant 
binary image data (expansion-resultant bi-level image 
data). 

A step S143B subsequent to the step S143A trans- 
fers the expansion-resultant binary image data from the 
data compressor/expander 8A to a printer 1 1 (see Fig. 
24). The step S143B activates the printer 1 1 so that the 
expansion-resultant binary image data is visualized or 
printed out by the device 1 1 . 

A step Si 44 detects information of the address of a 
sender related to the received e-mail. The step 1 44 con- 
trols a LAN controller 9 (see Fig. 24) so that a respon- 
sive e-mail confirming e-mail reception will be 
transmitted to the sender address. After the step Si 44. 
the current execution cycle of the program segment 
ends. 

Nineteenth Embodiment 

A nineteenth embodiment of this invention is similar 
to the embodiment of Figs. 24 and 25 except for design 
changes described hereinafter. 

Rg. 32 is a flowchart of a segment of a program for 
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controlling a CPU 1 (see Fig. 24) in the nineteenth 
ennbodiment. With reference to Fig. 32. a first step S151 
in the program segment decides whether or not image 
data of the e-mail format (an e-mail) has been received 
by a LAN controller 9 (see Fig. 24). This decision is to 5 
wait the reception of image data of the e-mail format. In 
the case where image data of the e-mail format has 
been received, the step SI 51 transfers the received 
image data of the e-mail format to a storage unit 4 (see 
Fig. 24), The step Si 51 controls the storage unit 4 so w 
that the received image data of the e-mail format is 
stored into the storage unit 4. 

A step 8152 following the step Si 51 transfers the 
received image data of the e-mail format from the stor- 
age unit 4 to an inverse format converter 10 (see Fig. 15 
24). The step SI 52 activates the inverse format con- 
verter 10 so that the received image data of the e-mail 
format is converted by the device 10 into corresponding 
image data of a given facsimile format. 

A step S153A following the step Si 52 adds recep- 20 
tion ID information to the image data of the facsimile for- 
mat. The reception ID information is generated on the 
basis of date and time unique for one year. The step 
SI 53A transfers the ID-added image data of the facsim- 
ile format to the storage unit 4 before storing the ID- 25 
added image data of the facsimile format into the stor- 
age unit 4. 

A step S153B subsequent to the step S153A trans- 
fers the ID-added image data of the facsimile format 
from the storage unit 4 to a data compressor/expander 30 
8A (see Fig. 24). The step S153B activates the data 
compressor/expander 8A so that the ID-added image 
data of the facsimile format is expanded by the device 
8A into expansion-resultant binary image data (expan- 
sion-resultant bi-level image data). 35 

A step Si 53C subsequent to the step SI 53B trans- 
fers the expansion-resultant binary image data from the 
data compressor/expander 8A to a printer 11 (see Fig. 
24). The step S153C activates the printer 1 1 so that the 
expansion-resultant binary image data is visualized or 40 
printed out by the device 11. 

A step SI 54 following the step S153C decides 
whether or not information equal to the reception ID 
information added to the image data has been inputted 
via an operation panel 7F (see Fig. 24). In the case 45 
where such reception ID information has been inputted, 
the program advances from the step SI 54 to a step 
SI 55. Othenwise, the program repeats the step SI 54. 
Thus, the step SI 54 waits the reception of the ID infor- 
mation. 50 

The step S155 analyzes the header of the received 
e-mail, and thereby detects a sender address corre- 
sponding to the reception ID information. The step SI 55 
controls a LAN controller 9 (see Fig. 24) so that a 
responsive confirmation e-mail will be transmitted to the 55 
sender address. After the step S155. the current execu- 
tion cycle of the program segment ends. 



Twentieth Embodiment 

A twentieth embodiment of this invention is similar 
to the embodiment of Figs. 24 and 25 except for design 
changes described hereinafter. 

Fig. 33 is a flowchart of a segment of a program for 
controlling a CPU 1 (see Fig. 24) in the twentieth 
embodiment. With reference to Fig. 33. a first step Si 61 
in the program segment decides whether or not charac- 
ter code data in an e-mail has been received by a LAN 
controller 9 (see Fig. 24). This decision is to wait the 
reception of character code data in an e-mail. In the 
case where the character code data in the e-mail has 
been received, the program advances from the step 
SI 61 to a step SI 62. TTie step SI 62 analyzes the 
"From" part of the header of the e-mail to detect a 
sender address. 

A step SI 63 following the step SI 62 decides 
whether or not the sender address agrees with a given 
address assigned to the present e-mail system. When 
the sender address agrees with the given address, the 
program advances from the step Si 63 to a step SI 64. 
Otherwise, the program advances from the step Si 63 to 
a step SI 65. 

The step SI 64 transfers a signal indicative of a 
transmission failure to a printer 11 (see Fig. 24). The 
step SI 64 activates the printer 1 1 so that the transmis- 
sion failure signal is visualized or printed out by the 
device 11. After the step SI 64, the current execution 
cycle of the program segment ends. 

The step SI 65 converts character code data in the 
text into corresponding image data. A step S166 follow- 
ing the step SI 65 transfers the image data to the printer 
11. The step SI 66 activates the printer 11 so that the 
image data is visualized or printed out by the device 1 1 . 
After the step S166, the current execution cycle of the 
program segment ends. 

Other Embodiments 

Any one of the second embodiment to the twentieth 
embodiment may be modified to indicate character 
code data in the received e-mail on a display such as a 
CRT. The CRT may also be used to indicate moving pic- 
tures. 

At least two of the first embodiment to the twentieth 
embodiment may be combined into an electronic mail 
system. 

Claims 

1. An electronic mail system connected to a network, 
comprising: 

means for converting an image of a document 
surface into corresponding document image 
data; 

means for compressing the document image 
data into compression-resultant image data: 
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means for converting the conrtpression-result- 
ant image data into corresponding image data 
of a given electronic-mail format; 
means for receiving information of an elec- 
tronic-mail destination address: and 5 
means for transmitting the image data of the 
electronic-mail format toward the electronic- 
mail destination address via the network. 

2. The electronic mail system of claim 1 , further com- io 
prising: 

means for receiving image data in an electronic 
mail; 

means for converting the received image data is 
into corresponding received image data of a 
given facsimile format; 

means for expanding the received image data 
of the facsimile format into expansion-resultant 
image data; and 20 
means for printing the expansion-resultant 
image data. 

3. The electronic mail system of claim 1 , further com- 
prising means for transmitting character code data 25 
by an electronic mail. 

4. The electronic mail system of claim 1, wherein the 
destination-address receiving means comprises 
means for recognizing an electronic-mail destina- 30 
tion address in a given position of the image data. 

5. The electronic mail system of claim 1 , further com- 
prising means for receiving information of an elec- 
tronic-mail sender address as information of an 35 
electronic-mail source address, and means for, in 
cases where a transmission failure occurs, inform- 
ing the electronic-mail source address of the trans- 
mission failure. 

40 

6. The electronic mail system of claim 1 , further com- 
prising means for receiving audio data, means for 
integrating the audio data and the image data into 
integration-resultant data, and means for transmit- 
ting the integration-resultant data as a single elec- 45 
tronic mail. 

7. The electronic mail system of claim 1 , further com- 
prising means for receiving moving-picture data, 
means for integrating the moving-picture data and so 
the image data into integration-resultant data, and 
means for transmitting the integration-resultant 
data as a single electronic mail. 

8. The electronic mail system of claim 3. further com- ss 
prising means for analyzing a character sequence 

in a given position of received character code data, 
and means for implementing a process in response 
to a result of said analyzing. 
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9. The electronic mail system of claim 8. further com- 
prising means for, in cases where the analyzed 
character sequence indicates registration of a des- 
tination mail address, registering sender ID infor- 
mation in a subsequent character sequence and a 
plurality of destination mail addresses while provid- 
ing a correspondence relation between the sender 
ID information and the destination mail addresses, 
and means for. in cases where sender ID informa- 
tion is received during mail transmission and the 
sender ID information is equal to the registered 
sender ID information, indicating the corresponding 
destination mail addresses and selecting a neces- 
sary destination from among the destination mail 
addresses. 

10. The electronic mail system of claim 8. further com- 
prising means for. in cases where the analyzed 
character sequence indicates registration of a 
source mail address, registering sender ID informa- 
tion in a subsequent character sequence and a 
source mail address while providing a correspond- 
ence relation between the sender ID information 
and the source mail address, and means for, in 
cases where sender ID information is received dur- 
ing mail transmission and the sender ID information 
is equal to the registered sender ID information, 
receiving the corresponding source mail address as 
a source. 

11. The electronic mail system of claim 9. further com- 
prising means for, in cases where sender ID infor- 
mation is received during mail transmission and the 
sender ID information is equal to the registered 
sender ID information, writing information of a 
source mail address corresponding to the sender 
ID information into a header of a mail as a source. 

12. The electronic mail system of claim 2, further com- 
prising means for providing a connection to a tele- 
phone line, and means for selectively transmitting 
the image data via the connection to the telephone 
line according to a facsimile procedure or via the 
network according to an electronic-mail procedure. 

1 3. The electronic mail system of claim 1 2, further com- 
prising means for analyzing a character sequence 
in a given position of character code data in a 
received electronic mail, means for. in cases where 
the analyzed character sequence indicates wait for 
facsimile data reception, recognizing a notice elec- 
tronic-mail address in a subsequent character 
sequence, means for, in cases where image data is 
received via the connection to the telephone line 
according to a facsimile procedure after the notice 
electronic-mail address is recognized, transmitting 
an electronic mail representative of a reception 
notice to the notice electronic-mall address. 
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14. The electronic mail system of claim 12, further com- 
prising means for analyzing a first character 
sequence in a given position of a header of image 
data in a received electronic mall, means for, in 
cases where the analyzed character sequence indi- 
cates facsimile transmission, recognizing a second 
character sequence in a given position of the 
header except the first character sequence as a 
facsimile number, and means for transmitting the 
received image data toward the facsimile number 
via the connection to the telephone line according 
to a facsimile procedure. 



for outputting information of a first page of the 
image data. 

21. The electronic mail system of claim 1 , further com- 
prising means for receiving character code data by 
an electronic mail. 



15. The electronic mail system of claim 1, further com- 
prising means for identifying a country having a is 
destination in response to the destination address, 
means for generating information of standard time 
in the identified country, and means for transmitting 
the image data as an electronic mail at a desired 
moment expressed according to the standard time 20 
in the identified country. 



16. The electronic mall system of claim 2, further com- 
prising means for registering a plurality of elec- 
tronic-mail addresses, means for storing and 25 
managing image data transmitted by an electronic 
mail for each of the electronic-mail addresses, 
means for setting pass words for the respective 
electronic-mail addresses, and means for output- 
ting the stored image data when a related pass 30 
word is received. 



1 7. The electronic mail system of claim 1 6, further com- 
prising means for generating Information of a cover 
sheet for each of the electronic-mail addresses, 35 
and means for adding the information of the cover 
sheet and outputting a resultant of said adding. 

18. The electronic mail system of claim 2, further com- 
prising means for, in cases where a first electronic 40 
mail is received, transmitting a second electronic 
mail representative of reception of the first elec- 
tronic mail to a sender electronic-mail address 
related to the first electronic mail. 

45 

19. The electronic mail system of claim 2. further com- 
prising means for writing reception ID information 
for each received electronic mail, means for provid- 
ing a correspondence relation between a sender 
electronic-mail address related to the received so 
electronic mail and reception ID information, and 
means for, in cases where the reception ID informa- 
tion is received, transmitting a conformation elec- 
tronic mail to the sender electronic-mail address. 

55 

20. The electronic mail system of claim 2, further com- 
prising means for, in cases where transmission of a 
received electronic mail fails, printing information 
representative of a transmission failure, and means 
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FIG. 5 
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FIG. 7 



10 



ROM 



RAM 



STORAGE 
UNIT 



FORMAT 
CONVERTER 



CPU 



INVERSE FORMAT 
CONVERTER 



12 



FONT 
MEMORY 



SCANNER 



OPERATION 
PANEL 



DATA 

COMPRESS/ EXPAND 



8A 



LAN CONTROL 



S LAN 



PRINTER 



CHARACTER 
RECOGNITION 



11 



13 



E-MAIL 
COMPUTER 



9A 



E-MAIL 
NETWORK 



9B 



BNSOOCID:<EP 0801492A1> 



27 



EP 0 801 492 A1 



FIG. 8 
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FIG. 9 
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FIG. 11 
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FIG. 14 



'11 



10 



ROM 



RAM 



STORAGE 
UNIT 



FORMAT 
CONVERTER 



INVERSE FORMAT 
CONVERTER 



12 



FONT 
MEMORY 



14 



AUDIO 

INPUT/OUTPUT 



16 



VIDEO 

INPUT/OUTPUT 



CPU 



1/ 



SCANNER 



OPERATION 
PANEL 



7C 



DATA 

COMPRESS/EXPAND 



8A 



LAN CONTROL 



> LAN 



PRINTER 



1/ 



CHARACTER 
RECOGNITION 



AUDIO 

COMPRESS/EXPAND 



MOVING PICTURE 
COMPRESS/EXPAND 



11 



13 



15 



17 



E-MAIL 
COMPUTER 



E-MAIL 
NETWORK 



9A 



9B 



BNSDOCID:<EP 0801492A1> 



34 



EP 0 801 492 A1 



FIG. 15 
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